International Journal of Engineering Research 
Volume No.4, Issue No.l, pp : 40 - 46 



ISSN:2319-6890)(online),2347-5013(print) 

01 Jan. 2015 



A Constrained Genetic Algorithm Based on Constraint Handling with KS 

Function and Grouping Penalty 

Jiang Zhansi 1 ' 2 , Jiang Yulong 1 , Ma Liquan 1 , Feng Jianguo 2 
(1. School of Mechatronics Engineering, Guilin University of Electronic and Technology, Guilin 541000,China 

2. Guilin Machine Tool Co. Ltd, Guilin, 541004) 



Abstract: In order to overcome the limitation when using 
traditional genetic algorithm in solving constrained 
optimization problems, this paper presents a new method 
of constrain handling to solve the constrained 
optimization problems. Firstly, the method makes full use 
of the condensed characteristics of the KS function to 
transform multi-constrained optimization problem into a 
single constraint optimization problem. And then a group 
penalty method is adopted by genetic algorithm. Aggregate 
constraint reduces the solution scale effectively and 
improves the efficiency of searching for global 
optimization solution. The method of penalty in grouping 
is used to overcome the difficulty of penalty coefficient 
selection for general penalty function method. Several 
typical numerical experiments and engineering 
application show the performance and effectiveness of the 
proposed algorithm. 

2. Key words: KS function; grouping penalty; genetic 
algorithm; constraint handling 
1. Introduction 

The engineering design problem usually can be transformed 
into constrained optimization problems. Most of 
optimization algorithms are efficient for unconstrained 
optimization problems or just with simple constraints. 
However, most engineering design problems may have 
many expensive constraints. To solve the constrained 
optimization problems, there exist some classical 
methods[l], such as penalty function method, Lagrangian 
multiplier method, Sequential Quadratic Programming(SQP) 
etc. But these gradient based optimization methods have 
some extra requirements, the objective and constrain 
function must be continuous and differentiable, and some 
even must be the high-order differentiable. Therefore the 
traditional optimization methods are not suitable for solving 
the discrete, discontinuous, derivative free optimization 
problems. 

Since the classical optimization methods can not satisfy the 



growing requirements in calculation speed, convergence, 
sensitivity to initial value and so on, some constraint 
handling techniques are proposed for heuristic algorithms, 
such as evolutionary algorithms. Static Penalty [2] , dynamic 
Penalty[3] and adaptive penalty[4] methods are the most 
widespread approach because of its simplicity and ease of 
implementation. However, how to define the penalty term 
and penalty factors are the difficult aspects of penalty 
methods. Therefore some parameter-less [5] scheme have 
been proposed. These kinds of method usually treat the 
constraints and objective function separately, and need not 
penalty factors. But, when dealing with a large number of 
constraints, there is a high computational cost. 
Since each penalty method has some limitations. A 
constrain handling combined with KS function and penalty 
in grouping are studied and applied to constrained genetic 
algorithm. KS function is used to transform constrains into 
a single continuous and differentiable constraint, and can 
reduce the solution scale effectively. In order to overcome 
the difficulty of defining the penalty term and penalty 
factors, a method of penalty in grouping is adopted. 

2. Theory 

2.1 The aggregation properties of KS function 
The KS function was first presented by G. Kreisselmeier 
and R. Steinhauser in 1979 [6]. It is expressed as a real 
valued function is defined in n-dimensional Euclidean space, 
which can be differentiable envelope in the index space. It 
defined as: 

(1) 



1 1 

KS(p, x) = — ln( Y exp(/? • g (x))) 
P j 



7=1,2,...,/ 



where p is a aggregation control parameter. 

Let g mM (x) = max{g.(x)} 

j 

(2) 

The alternate form is adopted to reduce numerical 
difficulties caused by large values: 
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KS(p, x) = gmax (x) + i-ln[£exp(p . (g . (x) _ (x)))] (3) 

The following relationship can be easily deduced form the 
definition of KS function: 

g m Jx)<KS<g m Jx) + \n(N)/p (4) 
From Eq(4), we can get: 

lim KS(X,p) = max( g (x)) (5 ) 

As p approaches infinity, the KS function becomes 
equivalent to g max (x) , the maximum of the all the 
constraints [7]. 

As shown in Fig.l, The solid lines denote the constraints. 
The dotted line indicates that the KS functions of 
constraints corresponding to different parameters p . It 

shows that, by using the agglomeration features of KS 
function method, multiple constraints can be condensed into 
a constraint, which can improve the efficiency of solving 
optimization problems. And the KS function has the 
properties of continuous and differentiable and can 
approach the maximum of a set of function curves. 




Fig. 1 . The Characteristic of KS function 



2.2The method of grouping penalty in GA 
Penalty function method is the most commonly used 
method for handing constraints in genetic algorithm. How 
to set up a reasonable penalty coefficient is a big difficulty 
for the penalty function method to handle constraints. If the 
values of penalty coefficient are too large, it may be 
guarantee searching within feasible region, but it will 
reduce the exploration with infeasible region, result in 
losing some valuable information provided by the infeasible 
region, which may bring premature convergence to a local 
optimal solution. If the penalty coefficient is too small, then 
the penalty plays a smaller proportion in the objective 



ISSN:2319-6890)(online),2347-5013(print) 

01 Jan. 2015 

function, it is difficult to find a feasible solution. 
The basic idea of penalty by grouping is using two penalty 
coefficients PI and P2 instead of one penalty as previous. 
The two penalty coefficients are related to the solutions of 
two different constraints satisfaction. This method has two 
advantages: Firstly, since the penalty coefficients are 
different, it will have different evolutionary trajectories of 
two groups of individuals. Because of the crossover and 
mutation in the two groups of individuals, it will increase 
the chance of escaping from the local optimal solution. 
Therefore it has better robustness than the general genetic 
algorithm. Secondly, in the constrained optimization 
problem, The global optimal solution usually located at the 
boundary between feasible and infeasible region. If a larger 
penalty coefficient (PI) and a lesser penalty coefficient (P2) 
are defined, convergence can be achieved from the 
boundary of feasible and infeasible region, Therefor, it will 
help us to quickly find the global optimal solution[8]. 
The proposed enhanced grouping penalty genetic 
algorithms with KS function (KS-GPGA) are presented as 
following: 

Stepl. Randomly generated 2m numbers of samples, where 
m is the population. 

Step2. Divide the 2m numbers of individuals into two lists, 
each list is assigned with a penalty coefficient, and the 
constraints are transformed into one constraint by KS 
aggregating. Calculate the adaptive values of the 2m 
numbers of individuals. 

Step3. Select the best m numbers of individuals from the 

2m numbers of individuals by adaptive values. 

Stp4. The m numbers of individuals are chosen to cross, 

mutation operator in genetic algorithm as initial point, Then 

create m numbers of new individuals. 

Step5. Mix m numbers of new individuals with m numbers 

of parent individuals to form a new 2m numbers of 

individuals. 

Step6. If not convergence, go to Step. 4. 

3. Experimental and numerical analysis 

There problems from Ref.[4] are solved to verify the 
performance of the new algorithm. And compared with 
group penalty genetic algorithms (GPGA). 
Problem 1. 
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4 4 13 

min f(x) = 5^ x. - 5^ x] - ^ x. 

i=l i=l i=5 

s.t. g l (x) = 2x x + 2x 2 + x 10 + x n - 10 < 0 

g 2 (x) = 2x x + 2x 3 + x 10 + x u - 10 < 0 

g 3 (x) = 2x 2 + 2x 3 + x n + x 12 - 10 < 0 

g 4 (jc) = -8jc 1 +x l0 <0 

g 5 (x) = -8x 2 +x n <0 

g 6 (x) = -8x 3 +x 12 <0 

g 7 (x) = -2x 4 -x 5 +x 10 <0 

g 8 (x) = -2x 6 -x 7 +x n <0 

g 9 (x) = -2x 8 -x 9 +x 12 <0 

0<x ? . <l(f = 1 9) 

0<X; < 100(7 = 10,11,12) 

0<x 13 <l 
The optimum of Problem 1 is: 

x* = [1, 1, 1, 1, 1, 1, 1, 1, 1, 3, 3, 3, 1] 
/(**) = -15 

Problem 2. 

min /(x) = (jq - 10) 3 + (x 2 - 20) 3 

(x) = -(x x - 5) 2 - (x 2 - 5) 2 + 100 < 0 
g 2 (x) = (x, - 6) 2 + (x 2 - 5) 2 - 82.8 1 < 0 
13<x x <100, 0<x 2 <100 

The optimum of Problem 2 is: 

x* = [14.095, 0.84296] 
f(x*) = -6961.81388 

Problem 3. 

n , x sin 3 (2nx, ) sin(2^x 7 ) 
max f(x) = — — 

X| (-^1 ^2 ) 

s.t. g l (x) = x\ - x 2 + 1 < 0 

^ 2 (x) = l-x 1+ (x 2 -4) 2 <0 
0<x x <10,0<x 2 <10 

The optimum of Problem 3 is: 

x =[1.2279713, 4.2453733] 
/(x ) = 0.095825 

Numerical experiments conditions are defined as flowing: 
The initial population is 70. The number of iterations is 150. 
The probability of crossover is 0.2. The probability of 
mutation is 0.5. And every test problem runs 20 times 
independently under the same conditions, and recording the 
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best value, the average value, the worst value and the 
standard deviation. A comparison of different results by 
genetic algorithm with the KS-GPGAis discussed. 

From the table 1, we can see that for these problems, two 
kinds of methods can get good approximate optima. And it 
shows that the results obtained by the approach presented in 
this paper is better, whether the best value, average value, or 
the worst value, and the results are more close to the 
optimal solutions. The standard deviations of KS-GPGA are 
smaller than GPGA. The standard deviation shows the 
variation of results obtained by different solving. The 
smaller the standard deviation, the more concentrated 
results can be achieved, and it shows higher reliability of 
the algorithm. Therefore, the KS-GPGA show more 
advantages in solving constrained optimization problems. 
In the Table 2, the method in this paper is compared with 
some methods in the literature researched before. In these 
methods, the Stochastic ranking method [5] can get better 
results. But this algorithm has great randomness. For some 
testing function, a feasible solution achieved after dozens of 
times solving. Therefore the stability should be taken into 
consideration. The test results show that the KS-GPGA can 
find the feasible optima solution at each run. 
4. Engineering application 

In order to further illustrate the effectiveness of this method, 
two engineering application are solved by KS-GPGA, and 
compared with existing methods. 

Application 1. Tension/compression string structure design 
problem [15]. 

This problem consists of minimizing the weight of a 
tension/compression spring (shown as Fig. 2) subject to 
constraints on minimum deflection, shear stress, surge 
frequency, and limits on outside diameter. The design 
variables are the mean coil diameter D(x 2 ); the wire 
diameter d(xi) and the number of active coils N(x 3 ). 
Formally, the problem can be expressed as fowling: 
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min f(x) = (x 3 + 2)x 2 x 1 



* l 71785** 



4x1 



1 



g 3 (x) = l 



12566(x 2 x 1 3 -x 1 4 ) 5108x; 
140.45x 



-1<0 



<0 



1.5 



-1<0 




Fig. 2. Tension/compression string structure design problem 
This problem has been solved as a benchmark for 
constrained optimization by exist methods. Table 3 shows 
Application 2. Design of a Pressure Vessel[15 ]. 
The pressure vessel problem is to design a compressed air 
storage tank with a working pressure of 3000 psi and a 
minimum volume of 750 ft 3 . The schematic of a pressure 
vessel is shown in Fig. 43. The cylindrical pressure vessel is 
capped at both ends by hemispherical heads. Using a rolled 
steel plate, the shell is to be made in two halves that are 
joined by two longitudinal welds to form a cylinder. Each 
head is forged and then welded to the shell. 




Fig. 4 Pressure vessel 

Let the design variables be denoted by the vector: 
X =[x v x 2 , x 3 , x 4 ] = [Th, Ts, R, L] , where Th is the 

spherical head thickness, Ts is the shell thickness, R and L 
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the results of KS-GPGA compared with existing methods. 
After 20 times of runs, the mean value achieved by 
KS-GPGA is better than others. 

0.0155 



0.015 



0.0145 



0.014 



0.0135 



0.013 



0.0125 



50 



100 



150 



Fig. 3. Convergence process of solving tension/compression 



string fcrobleml by KS-GPGA 



are the radius and length of the shell, respectively. The 
objective function is to reduce the combined costs of 
materials, forming, and welding of the pressure vessel. The 
mathematical model of the problem is expressed as follows: 

min f(X) = 0.6224^X3X4 +1.778 lx 2 x 2 3 +3.161 lxfx 4 + 19Mxfx 3 
s.t. g l (X) = 0.0193x 3 -x l <0 



-x 2 <0 



g 2 (X) = 0.00954*3 
g 3 (X ) = 750 x 1728 - nx\x 4 - \nx\ 1 3 < 0 
jqe(0.1, 99), x 2 e(0.1, 99) 
x 3 e(10, 200), x 4 e(10, 200) 



Where the design variables x 3 and x 4 are continuous and x 1? 
x 2 are integer multiplies of 0.0625. 

Table 4 shows the results of KS-GPGA compared with 
existing methods. After 20 times of runs, the mean value 
achieved by KS-GPGA is also better than others. The 
convergence process of solving pressure vessel design 
problem by KS-GPGA is illustrated as Fig. 5 
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Fig.5. Convergence process of solving pressure vessel 
problem by KS-GPGA 
5. Conclusions 

Because of each constraint handling methods may Only 
suitable for a certain class of optimization problems. This 
paper presents a method KS-GPGA merging KS aggregate 
constraint function and grouping penalty method in genetic 
algorithm to solve constrained optimization problems. After 
the aggregate constraints with KS function, the constrained 
optimization problem is transformed to a single constraint 
optimization problem. Because the KS function has the 
properties of continuous and differentiable and can 
approach the maximum of a set of constraints, the 
simplified constraint is helpful to improve the 
computational efficiency. Method of grouping penalty is 
used to overcome the difficulty of penalty method to select 
the penalty factors. Several typical numerical experiments 
and engineering application show the reliability and 
effectiveness of the proposed algorithm. 
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Table 1 . Comparison of numerical results by two methods 



Proble 
m 


Optimal 
value 


GPGA 


KS+GPGA 


best 


mean 


worst 


St.dev 


best 


mean 


worst 


St.dev 


1 


-15 


-14.99 
9 


-14.90 
0 


-13.03 
4 


0.4395 


-15.000 


-14.99 
9 


-14.99 
8 


0.0006 


2 


-6961.8 
1388 


-6961. 
8 


-6961. 
7 


-6960. 
7 


0.2428 


-6961.8 


-6961. 
7 


-6961. 
6 


0.2406 


3 


0.09582 
5 


0.0958 
25 


0.095 
825 


0.0958 
25 


8.3586E 
-09 


0.0958 
25 


0.0958 
25 


0.0958 
25 


9.2189E 
-09 



Table 2. Comparison of the best value for the test functions of several methods 



Probl 
em 


Optimal 
value 


Koziel and 
Michalewi 

ez 

[9] 


Runarss 
on and 

Yao 

[10] 


Tessema 
and Yen 
[11] 


Deb 
[12] 


Farmani 

and 
Wright 

[13] 


Venkatra 
man and 

Yen 

[14] 


KS+GP 
GA 


1 


-15.0000 


-14.7860 


-15.0000 


-15.0000 


-15.000 
0 


-15.000 
0 


-14.999 
9 


-15.000 
0 


2 


-6961.813 
88 


-6952.110 


-6961.81 
4 


-6961.04 
6 


NA 


-6961.8 
00 


-6961.1 
79 


-6961.8 
000 


3 


0.095825 


0.095825 


0.09582 
5 


0.09582 
5 


NA 


0.09582 
5 


0.09582 
5 


0.09582 
5 
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Table 3. Result comparison of the tension/compression string problem 



Methods 


Xl (d) x 2 (D) 


x 3 (N) 


fix) 


Arora[17] 


0.053396 


0.399180 


9.185400 




0.0127303 






Coello[16] 


0.051989 0.363965 


10.890522 




0.012681 






M-5[18] 


0.05000 


0.315900 


14.25000 




0.01283343 




OPTDYN[18] 


0.0644 


0.7488 


2.9597 




0.01540256 




KS+GPGA 


0.0528 


0.3482 


9.8456 




0.01268 







Table 4. Result comparison of the pressure vessel design problem 



Methods 




x 2( T h) 


x 3 (R) x 4 (L) 


fix) 


CPSO [21] 


0.8125 


0.4375 
6061.0777 


42.0912 


176.7460 


ADPSO [21] 


0.8125 


0.4375 
6059.7143 


42.0985 


176.6370 


SCPSO [22] 


0.8125 


0.4375 
6059.7143 


42.0984 


176.6366 


CAL-PSO™ 


0.8125 


0.4375 
6051.7504 


42.0863 


176.3824 


ICOGA [19] 


0.8125 


0.4375 
6057.9092 


42.0924 


176.6028 


KS+GPGA 


0.8441 


0.4173 
6008.4450 


43.7332 


157.3806 
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